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The  notion  of  time-frequency  (TF)  analysis 


MUSIC  LINEAR  CHIRP  (SWEEP)  FREQUENCY  SHIFT 

KEYING  (FSK) 
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Auditory  perception  as  TF  analysis 
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The  TF  plane 


•  Visualize  time-frequency  location/concentration 
of  signal  x(t): 
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Linear  TF  analysis 


•  TF  analysis:  Measure  contribution  of  TF  point  (t0,  f0)  to 
signal  x(t) 

•  General  approach:  Inner  product  of  x(t)  with  “test  signal” 
or  “sounding  signal”  *Pt0j0(t)  located  about  ( t0 ,  /0): 

oo 

LTFRrr(fo,  /o)  :=  (x^t0J0)  =  J  x(f)  ^t0J0^  dt 

—  OO 

LTFR  =  Linear  TF  Representation 
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Linear  TF  synthesis 


•  TF  synthesis  (inversion  of  LTFR):  Recover  (“synthesize”) 
signal  x{t)  from  ltfr^r^/o) 

•  General  approach: 

oo  oo 

x(t)  =  J  j  LTFRa;(io,  /o)  $t0J0(t)  dtodfo 

—  OO  — OO 

x(t)  is  represented  as  superposition  of  TF  localized  signal 
components,  weighted  by  “TF  coefficient  function”  LTFR^fo,  /o) 

•  Problem:  How  to  construct  test  (analysis)  functions  ^t0,/0(f) 
and  synthesis  functions  4>tQ  f0(t)? 
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Quadratic  TF  analysis 


•  TF  analysis:  Measure  “energy  contribution”  of  TF  point  (to,/o) 
to  signal  x(t) 

•  Simple  approach: 

QTFRa,(f0, /o)  :=  |LTFRx(f0,/o)|2  =  \(x^t0,f0)\2 

OO  OO 

=  J  J x(t1)x*(t2)^t0j0{t1)ipt0j0(t2)dt1dt2 

—  OO  — OO 

QTFR  =  Quadratic  TF  Representation 

•  Want  QTFR  to  distribute  signal  energy  ex  over  TF  plane: 

oo  oo 

J  J  QTFRx(f ,  /)  dtdf  =  Ex  “TF  energy  distribution” 

—  oo  — OO 

•  Problem:  How  to  construct  test  (analysis)  functions  '/’/0,/0(0? 
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Construction  of  analysis/synthesis  functions 


•  Problem:  Construct  family  of  analysis  functions  {ipt0j0(t)} 
such  that  ipt0j0(t)  is  localized  about  TF  point  Oo./o) 

•  Systematic  approach:  *Pt0j0(t)  derived  from  “prototype 
function”  ip{t)  via  unitary  “TF  displacement  operator”  ufo  /o : 

■=  (U t0,f0^)(t) 

•  Same  for  synthesis  functions  {$t0,/0(f )}  '■ 

■=  (Ut0)/o$)W 

•  Two  classical  definitions  of  u tQjQ : 

-  TF  shift 

-  TF  scaling  (compression/dilatation)  +  time  shift 
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Two  classical  definitions  of  operator  U 


TF  shift: 

vwoW  =  K./o^)^) 

=  ip(t  —  to)  ej27r^°* 


TF  scaling  +  time  shift: 

^o,/oW  =  (Uto./oV'JCO 

=  \tAu^ 


ya  \  a 


a=U/fo 
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Short-Time  Fourier  Transform  (STFT) 


•  Recall  TF  shift: 

VWoW  =  (uWo^)(0  =  ^t~t  o)ej2nfot 

•  =>  LTFR  =  STFT: 

oo 

STFT*(f0,/o)  =  (x,VtQjoip)  =  I  x(t)r(t-t0)e-^fotdt 

—  OO 

STFT  =  FT  of  local  (windowed)  segment  of  x(t)\ 
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STFT  signal  synthesis 


•  Recall  STFT  analysis: 

oo 

STFT*(to,/o)  =  (x,UtQjoip)  =  I 

—  oo 

•  STFT  signal  synthesis: 

oo  oo 

x(t)  =  j  J  STFTx(t0,f0)(\Jtoj0'if^(t)dt0df0 

—  OO  — OO 
OO  oo 

=  J  J  STFTx(i0,/o)^(i-io)ej27r/o^io#0 

■ — oo  — oo 

x(t )  is  weighted  superposition  of  TF  shifted  versions  of  $( t ) 


WAMA-04  Cargese,  France  -15- 


Wavelet  Transform  (WT) 


Recall  TF  scaling  +  time  shift: 

=  (U  t0,f0ip)(t)  =  ^(^(f-f0) 

=>  LTFR  =  WT: 

OO  \~e~ 

WT^fc/o)  =  (*,U toJoip)  =  j x(t)  ^r(j\t-t0) 


dt 
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WT  signal  synthesis 


Recall  WT  analysis: 


WTaCio./o)  =  (*,U t0,f01p)  =  j x{t) 

WT  signal  synthesis: 

oo  oo 

x(t)  =  /  J  WTx(t0,fo)  (ut0j0$)(t)dt0df0 


0  —oo 
oo  oo 


0  —  oo 


/  /  WTx(to,fo)  ^$(^(t-t0))dt0df0 


\  f<p  V/v> 


x(f )  is  weighted  superposition  of  TF  scaled  and  time  shifted 
versions  of  $(t) 
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Spectrogram  and  scalogram 


Recall  LTFR^QTFR: 

QTFRx(f0,/o)  =  LTFRxCfo,  /o)  2  = 

(*.ut0,/o^)  2 

STFT  ->•  spectrogram: 

OO 

SPEC^fo./o)  :=  STFT,(*o,/o)  2  = 

J  x(t)i>*(t -to)  e~i2n- dt 

—oo 

•  WT  ->■  scalogram: 


SCALaT^o,  /o)  :=  WTa;(fo,/o) 
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STFT  and  constant-BW  filterbank:  analysis 
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Spectrogram  analysis  as  constant-BW  filterbank 
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STFT  /  spectrogram:  example 
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WT  and  constant-Q  filterbank:  analysis 


WT  analysis  as  convolution: 


WTx(to,/o)  =  [  x(t)  f  r(f(t-t0) 

-oo  N  ^ 

=  x(t)  * 

Filterbank  interpretation/implementation: 


\  V 


dt 


J  t=t0 


X(t)~ 


</o> 
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WT  and  constant-Q  filterbank:  synthesis 


WT  synthesis  as  convolution: 


<t)  =  j  j  WT,(t0,/0) 

0  —  oo 


oo 

/ 


WTa;(fo,  /o)  * 


/o  jf  fo  . 


dfo 


t0  =  t 


Filterbank  interpretation/implementation: 


WTt(//(J) . 


(/;  D 


WTv(//0) - ►  «,) 


© — ► 
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Scalogram  analysis  as  constant-Q  filterbank 
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WT  /  scalogram:  example 
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STFT  /  spectrogram  vs.  WT  /  scalogram 


STFT  /  spectrogram  WT  /  scalogram 

/♦  /t 
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Good-bye  and  hello 


•  Good-bye  to: 

-  STFT 

-  spectrogram 

-  constant-BW  analysis 

•  Hello  to: 

-  affine  class  of  QTFRs 

-  Wigner  distribution  and  Bertrand  distribution 

-  hyperbolic  TF  localization 
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Axiomatic  (covariance-based)  definition  of  WT 


•  Generic  LTFR  expression: 

oo 

i/i  i- 1; ,  (/.  /)  =  /  x{t')  Kit'- 1,  /)  dt' 

—  oo 

•  Covariance  of  LTFR  to  TF  scalings  +  time  shifts: 

y(t)  =  ^=x(—)  o  Y(f)  =  ^X(a/)e')2ir/ 

Va  V  a  J 

=>  LTFRj/(i,  /)  =  LTFR*  (^=-7  a/) 

•  Can  show  that  covariant  LTFRs  are  given  by  WT 

°°  7“  OO 

WT  x(t,f)  =  J  x(t')  —ip*  (^-(t'-t)jdt'  =  J]  j  x{t')<j>(fit'-tj}dt' 

—  OO  '  ^  ^  — OO 
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Axiomatic  (covariance-based)  definition  of  the  affine  class 
of  QTFRs 


•  Generic  QTFR  expression: 

00  00 

QTFR x(t,f)  =  J  J  xit^x*^)  K(t1,t2m,t, /)  dt1dt2 

—  00  —00 

•  Covariance  of  QTFR  to  TF  scalings  +  time  shifts: 

y(t)  =  ^-x(—)  o  Y{f)  =  V^Xiaf)e~^Tf 
Va  V  a  J 

=*  QTFRy(i,  /)  =  QTFR,  a/) 

•  Can  show  that  covariant  QTFRs  are  given  by 

00  00 

AC x(t,f)  =  f  J  J x(t1)x*it2)<j>{fiti*-t),f(t2-t))dtidt2 

—  00  —00 

AC  =  Affine  Class 
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The  affine  class  of  QTFRs 


Affine  class  of  QTFRs: 

oo  oo 


AC =  f  J  j  x(t1)x*(t2)4>(f(t1-t),f(t2-t)')dt1dt2 

—oo  —oo 

2-D  “kernel”  <t>(a1,a2)  specifies  QTFR  of  the  AC 
Scalogram  is  a  member  of  the  AC;  its  kernel  is  separable'. 

=  rAfXf) 

Expression  of  AC  QTFRs  in  terms  of  signal's  FT: 

oo  oo 

AC  *(*,/)  =  J  J  J  XUi)X*U2)*(t±-M  e^fi-f^dhdh 


0  0 


WAMA-04  Cargese,  France 


Affine  class  and  affine  group 


•  TF  scaling  +  time  shift: 

(Ufl,Ta:)(t)  =  =  \[/3  x(/3t  +  7)  =:  (U/3,7a;)(t) 

•  Affine  time  transformation  t  pt  +  7  (“clock  change”) 

•  Composition  of  clock  changes  is  another  clock  change: 

^2)72^1)71  =  ^1^2)71+^172 

•  =>  Ug)7  is  unitary  representation  of  the  affine  group: 

-  Set:  (/?,  7)  e  R+x  R 

-  Group  operation:  (/?1;7l)o  (^2, 72)  =  (^i/?2,  7i  +  18172) 

-  Neutral  element:  (/?o>7o)  =  (1)0) 


WAMA-04  Cargese,  France 


“34"  - 


OUTLINE 


•  The  notion  of  time-frequency  analysis 

•  Linear  and  quadratic  time-frequency  analysis 

•  Short-time  Fourier  transform  and  wavelet  transform; 
spectrogram  and  scalogram 

•  Constant-bandwidth  analysis  vs.  constant-Q  analysis 

•  The  affine  class 

•  Affine  time-frequency  smoothing 

•  Hyperbolic  time-frequency  localization 


WAMA-04  Cargese,  France  -  35  - 


The  Wigner-Ville  Distribution  (WVD) 


•  Prominent  member  of  the  AC:  the  WVD 

oo 

WVD x(t,f)  =  J  x(t  +  -  0  e-i27r/Tdr 

—  oo 

•  Properties  of  the  WVD: 

-  Covariant  to  TF  scaling  and  time  shift  (of  course) 

-  Covariant  to  frequency  shift  =>  not  constant-Q 

-  Real  for  any  (real  or  complex)  signal  x(t) 

-  Marginal  properties:  e.g.,  /  WVD x(t,f)dt  =  \X(f)\2 

J  —  oo 

-  Localization  properties:  e.g.,  WVD x(t,f)  =  S(f-fo) 
for  x(t)  =  ej27r^ 

-  Many  more... 
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Interference  terms  in  the  WVD 


WVD  X1+X2(t,f)  =  WVD  Xl(t,f)  +  WVD  X2(t,f) 
+  2Re{wVD  xl,X2(t,f)} 

v - v - / 

Interference/cross  term 


t 

Source:  P.  Flandrin,  Temps-frequence.  Hermes,  Paris,  1993 
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Constant-BW  smoothing  of  the  WVD 


Smaller/less  interference  terms 


Poorer  TF  resolution 


Source:  P.  Flandrin,  Temps-frequence.  Hermes,  Paris,  1993 
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AC  expression  in  terms  of  WVD 


•  Any  QTFR  of  the  AC  can  be  expressed  in  terms  of  the  WVD: 


where  a(a,/3)  is  related  to  a2)  and  <t>(/3i,/32)  by  FTs 

•  If  a(a,( 3)  is  a  smooth  function,  then  ACx(t,f)  is  a  smoothed 
version  of  wvd^O,  /) 

•  Smoothing  causes... 

-  smaller/less  interference  terms 

-  poorer  TF  resolution 

Affine  (constant-Q)  smoothing,  different  from  constant-BW  smoothing 
shown  on  previous  slide! 


CXJ  CXJ  /  »/\ 

•  Recall:  ACx(t,f)  =j  f  WVDx(t\  f)  dt'df 


oo  oo 


Smoothing  function 


i 


poor  time  resolution 
good  frequency  resolution 
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Affine  smoothing:  example 


Smaller/less  interference  terms 


Poorer  TF  resolution 


Source:  P.  Flandrin,  Temps-frequence.  Hermes,  Paris,  1993 
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Scalogram  as  smoothed  WVD 


Recall  scalogram: 


SCALsCi,/)  :=  WT*(i,/)  = 


oo 

[  x(tf)  —  ^*(— (t'-t^dt* 
\  J 'Ip  \  J'lp  ' 


Expression  of  scalogram  as  smoothed  WVD: 

oo  oo  / 

SCALx(t,  f)  =  I  j  WVD  x(t\f)  WVDjj-(  t'-t) 


0  — oo 


f  (*-*),  7 jr)dt,df 

J'lp  J  /  J'lp 


Smoothing  function 
is  WVD  of  wavelet: 

r(a,/3)  =  WVD 
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Affine  WVD  smoothing  and  constant-Q  analysis 


Scalogram  as  smoothed  WVD: 

oo  OO  ,  .  \ 

SCALx(t,  f)  =  IJ 

OO  £  2 


h . 
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Constant-BW  vs.  affine  (constant-Q)  smoothing 


Poorer  TF  resolution 


-44- 
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Doppler-tolerant  signals 


TF  scaling  /  Doppler  effect: 

(C  ax)(t)  =  -^=x(-')  y/aX(af) 

ya  \aJ 

“Doppler-tolerant”  signal  =  eigenfunction  of  c« : 

(C  ax)(t)  =  A  ax(t) 

Solution:  “hyperbolic  impulse” 

XU)  =  HcU) 

Group  delay: 


_^p-j27rcln(///r) 

Vf 


r(f)  =  -^arg{iTc(/)}  =  - 

2tt  af 

Hyperbola  in  the  TF  plane 
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Example:  Bat  sonar  signals 
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Hyperbolic  TF  localization 

•  Want  AC  QTFR  to  satisfy  hyperbolic  TF  localization  property: 

X(f)  —  e-j2nc\n(f  /  fr) 

VJ 

fi 

=*  AC  x(t,f)  = 

^ J 

0  * 

•  Not  satisfied  by  WVD  ! 
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The  Bertrand  Pn  distribution 


The  hyperbolic  TF  localization  property  is  satisfied  by  the 
(unitary)  Bertrand  P0  distribution 

oo 

BE =  f  I  x(f\(u))x*(f\(~u))e^tun(u)du,  f>  0 

—  OO 

with 


A(n)  =  - 


u/2  u/2 
sinh(w/2)  ’ 


m(«)  =  - 


u/2 


sinh(n/2) 


The  Bertrand  P0  distribution  is  a  central  member  of  the  AC. 
It  satisfies  several  important  properties  (besides  the  hyper¬ 
bolic  TF  localization  property). 
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Bertrand  P0  distribution  as  generator  of  the  AC 


Any  QTFR  of  the  AC  can  be  expressed  in  terms  of  the 
Bertrand  P0  distribution: 

AC  x(t,f)  =  7  7  BERx(t\  f')  77]  dt'df', 

0  -oo  ^  *  ' 

where  5-(«,/3)  is  related  to  <r(a,p) 

Special  case:  scalogram 

SCAL  *(*,/)  =J  J  BER 


0  —oo 


Smoothing  function 
is  BER  of  wavelet: 

a(a,/3)  =  BER^(^’A^) 
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Mellin  transform  and  hyperbolic  marginals 


Recall  hyperbolic  impulse  HcU)  = 


—  _jL  „-j27rcln(///r) 


v7 


Mellin  transform: 

°°  d  f 

Mx(c )  =  (X,HC)  =  I  X(f)  ei27rcln(///»-)_^ 


0 


Hyperbolic  marginal  property: 

00 

/  AC  =  \Mx(c)\2 


Integrate  AC Jt,J)  over  TF  hyperbola  t=c!f 


Not  satisfied  by  WVD...  but  satisfied  by  Bertrand  P0  distri¬ 
bution  ! 
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Application:  TF  analysis  of  gravitational  wave 
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Source:  E.  Chassande-Mottin  and  P.  Flandrin,  On  the  time-frequency  detection  of  chirps. 
Appl.  Comp.  Harm.  Anal.,  6(9):  252-281,  1999. 
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Conclusion 


•  Linear  and  quadratic  TF  analysis 

•  Short-time  Fourier  transform  and  spectrogram 

•  Wavelet  transform  and  scalogram 

•  Filterbank  interpretation:  constant-BW  analysis  versus 
constant-Q  analysis 

•  Scaling/shift  covariance  and  affine  class  of  QTFRs 

•  Wigner-Ville  distribution  and  affine  smoothing 

•  Doppler  tolerance  and  hyperbolic  impulses 

•  Hyperbolic  TF  localization  and  Bertrand  P0  distribution 

•  Mellin  transform  and  hyperbolic  marginal  property 
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